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l.  Summary-  This  paper  starts  from  a (p+q) -variate  normal  population 
(p  < q)  with  a p.d.  dispersion  matrix  consisting  of  submatrices 
£^(p  x p) , Lgg(q  X ^ig(p  x *1)  which  stand  respectively  for  the 

dispersion  matrix  of  the  p-set,  the  q-set  and  that  between  the  p-set 
and  the  q-set,  and  then  defines,  in  a natural  manner,  the  matrix  of 
regression  of  the  p-set  on  the  q-set,  in  the  form  ^2^22'  ^is  matrix 

is  denoted  by  B(p  x q)  ana  a bilinear  function  d^(l  x p)(3(p  x q)d^(q  x 1) 

is  considered  where  d,(p  x l)  and  dc(q  x l)  are  two  arbitrary  vectors, 
each  of  unit  modulus.  Simultaneous  confidence  bounds  are  given  on  all 
such  bilinear  compounds  dpdg  with  a joint  confidence  coefficient  greater 


than  or  equal  to  a prea  signed  level.  For  this  purpose  certain  results 
and  techniques  are  used  which  were  discussed  in  previous  papers  /~1,2,3._7 
2.  Introduction.  We  recall  the  confidence  statement  ('A.k)  ~f , 

with  a confidence  coefficient  1 - o: 
t (n-2) 

/v ' ' 


(2.1)  b - 


a 


P?  Bl  t (n-2) 

(1  - r ) — < B < b + — — 

rr. — 8 2 ~ - r~>- 


where  B (which  is  now  a scalar)  stands  for  the  po.pulati j.--  regression 
of  x on  (where  and  x^  have  a bivariate  normal  distribution), 

b for  the  sample  regression  (in  a random  sample  of  size  n > 3),  r 
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for  the  sample  correlation,  and  80  for  the  two  sample  standard  deviations 
arid  t for  the  upper  2/ 2 -point  of  the  t -distribution  with  D.F.(n-2). 

We  also  note  that 


(2.2)  b = tbJ&2  = rsl82//E 


and  P = P°1a2/a2 


where  p,  o^,  and  stand  respectively  for  the  population  correlation 

coefficient  and  the  two  standard  deviations. 

Denoting  by  C(M)  the  characteristic,  root  of  a p x p matrix  (whose 
elements  are  real  or  complex  numbers)  we  recall  also  / 2,  (1.2)_/  that, 
if  a(p  x q)  and  E(q  x p)  are  two  such  matrices,  then 

(2.3)  C(AB)  = C (Bn) , 

meaning  thereby  that  any  non-zero  root  of^vB)is  also  a non-zero  root  of 
(Ba)  and  vice  versa. 

We  also  note  that 


(2 .4)  tr  (AB)  = tr  (Ba) . 

We  further  recall  £" 2,  (2.2.4)_7  that  if  A and  B are  two  p x p hermitian 
matrices,  one  of  rfhich,  say  A,  is  p.d.  and  the  other,  i.e.,  B,  at  least 
p.s.d.,  then,  denoting  by  c and  c . the  largest  and  the  smallest 

characteristic  roots,  we  have 


(2.5)  c (A)  c . (B)  < all  c (AB)  < c («)  c (B\ 

• ' min'  ' min'  — ' — max'  max'  ' 

We  next  recall  J_  first  paragraph  of  section  3 J that 


(2.6) 


"If 


V 


then  E2" 


II 


El(.  V > P(E1)  < P(E2 ) • 
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We  now 
from  a 


(n-1) 


start  £~1,  section  6.2 J with  a random  sample  of  size  n ( > p+q;  p < q) 


/ . \ 
^Fr<i7~ 
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where  S and  stand  respectively  for  the  sample  dispersion  sub- 

matrices of  the  p-set,  the  q-set  and  that  between  the  p-set  and  the  q-set 
and  where  Y^  and  Y^  have  the  p.d.f . 


(2.7) 


const,  exp. 


[ 


-I  tr 


We  next  recall  section  6.2_7  that  there  exist  non-singular  p^(p  x p) 


and  |ig(q  x q)  such  that 

(2.8)  'r-11(p  x p)  = u1(p  X p)  q|(p  X p),  ^22(q  X n)  = u2(q  x q)  u£(q  x q) 

and  \2iv  x q)  = ^(p  x p)  (D^  C)  |i^(q  x q)  , 

P q-p 

where  D,-—  stands  for  a diagonal  matrix  the  squares  of  whose  diagonal 


elements  are  the  (all  non-negative)  characteristic  roots  of  the  matrix 

£j.2^22^12  (i.e.,  the  squares  of  the  population  canonical  correlations 
between  the  p-set  and  the  q-set).  As  in  £~  1,  section  6.2_7>  denoting  by 
I(m)  an  m x m identity  matrix,  we  have 
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Going  back  to  (2.7)  and  using  (2.4)  we  have  now 


where 


<2-n>  Zl'“ Il-(D °W  h> 

Ji/T-O  lQ/i-0 


Thus  it  is  easy  to  check  from  (2.7),  (2.10)  and  (2.11)  that  (Z^,  Z^) 
have  the  p.d.f. 


(2.12)  const,  exp.  tr  j(Z|  Z£)  , 


Consider  now,  for  any  two  arbitrary  non-null  vectors  a^(p  x l)  and 
a£(q  x l)  and  for  a fixed  positive  ©n,  the  statement 


(2.13)  (*[  Z1  Z'2  a2)2 


(Si  Zx  Z-  ax)(a-  Z2  Z-  a,) 


* ®0  > 


which  can  be  written  in  terms  of  Y^  and  Y2  as 


ca  » okV^sf1  hJ 

^ 7n  40/i  -0  1 


(2.1^) 


where 


sfl/l  - 0 


(a^p21Y2Y^n^_1a2) (a|QQ'a1) 


(2.15)  Q - D H 

417TT0 


d o'!  u".1?. 


Now  putting 


(2.16)  b^(l  x p)  = D li"1  and  b^(l  x q)  = a^"x  , 


and  using  (2.8)  and  (2.6),  we  check  that  (2.l4)  reduces  to 


Aj  <YjY2  ~ gY2Y2)  *2-/ 

(b2Y2Y2^2}  Ai(VPY2)( Y1  “ Y2P,) 


^eo 


or 

Z~£l<sia  ' psa2>£a-7 < 9 

(»^2a&2>  Ai<su-Si^'  - ^i2+p02a9,)£1-7  “ ° 

where 

(2.17)  P(p  X q>  - ^(r^-  o)  pj1  - ^ . 

p defined  by  (2.17)  can  be  appropriately  called  the  matrix  of  population 
regression  of  the  p-set  on  the  q-set  and  it  is  the  only  set  of  population 
parameters  that  occurs  in  the  statement  (2.17) ♦ 

3.  Confidence  bounds  on  the  regression  matrix  &. 

It  is  well  known  [~ lj  that  the  statement  (2.17),  for  all  arbitrary 
non -null  b^  and  b2,  is  exactly  equivalent  to 

(3.1)  all  S.'s  < QQ  or  ©p  < 0Q, 

where  S.'s  (i  = 1,  2,  ...,  p;  0<9,  < ...  < © < l)  are  the  roots  of 

l - 1 - - p - 

the  determinantal  equation  in  Q: 

|e(Su-s12p.-BSi2+ps22P')  - (=12-?s22)s-i(si2.s22p')j  . 


(3.2) 


0. 
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Kow  put  >-  - 9/l  - Q;  so  that  we  have  from  (3,2),  the  determinantal 
equation  in  \ 


(5.3)  I x(sn.sJ2s^si2)  - (s12s-^  - e)s22(s^sl2  - »«)\  - 0. 

The  statement  (3*1)  can  now  he  replaced  by  the  statement  that 
(3.^)  the  largest  characteristic  root  < ©q/1  - ©q> 


(3.5)  all  c iT(s11-Si2S22Si2)’:i(B'P)S22(B,"p,)-7  - Q0/(1'60'  ’ 
where 

(3.6)  B(p  x q)  = S12S‘^  , 

which  may  be  appropriately  called  the  matrix  of  sample  regression  of 
the  p-set  on  the  q-set. 

We  note  that  (3..;)  (5.1)  1 \ 1 (2.13),  so  that  is  the  largest 

characteristic  root  of  the  matrix  (Z^Z^)”^(Z^Z^) (Z^Zp "^(Z^Zp , where 

(Z1,  Zg)  have  the  p.d.f.  (2.12).  The  joint  distribution  of  these  central 

6 's,  and  also  of  the  largest  root  ©^  being  known,  all  that  we  have  to  do 
i P 

to  make  (3-5)>  i.e.,  (3.1),  i.e.,  (2.13),  a simultaneous  confidence  state- 
ment with  a Joint  confidence  coefficient  1 - r is  to  choose  9n  = ©- (p,<l.>n..l) 

where  the  quantity  on  the  right  hand  side  is  defined  by 

(3.7)  P (central  9 > Oj  = a. 

P ” 0 

Substituting  now  9„(p,  q,  n-l)  (to  be  sometimes  denoted  more  simply 
by  Q_.)  for  0Q  in  (3.5),  we  have  a simultaneous  confidence  statement  with  a 
joint  confidence  coefficient  1 - al 
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Now  applying  (2.5),  (2.5)  and  (2.6)  (in  the  same  manner  as  in 
f3J),  we  have  from  (3.5),  nov  with  a Joint  confidence  coefficient 
> 1 - a,  the  following  simultaneous  confidence  statement 


(3.8)  all  c /~(B  - 6)(B'  - 0')_7  < __2_  cnax^Sll”S12S22Si2^  x cmax^S22^* 


1-©. 


Now  note  that  ^(S’*)  = l/c„ln(S22)  > 


cmax(SirS12S22Si2)  - Sax(I  * SllSi2S22S12)  and 

=--‘I"SliS12S223i2)  ' 1 - C»lnl3nS12322Si2>  ' 


max 


Using  these,  we  check  that  (3.8)  can  he  replaced  by  the  following  (with 
a confidence  coefficient  >1  — at) : 


(3.9)  all  c r (B  - 8) (B ' - 0')_7  < C1  " cmin^SllS12S22Sl2^7 

X-°G 

x cmax^sil^cmin^s22^  * 

we  next  recall  the  following  two  well-known  results  (repeatedly  used  in  £"\J) 

(3.10)  all  c(M)  < g (for  a p x p real  matrix  M with  real  roots) 

^ d^  (1  x p)  M(p  x p)  dx(p  x 1)  (for  all  arbitrary  unit  vectors 

(3-11)  x'  (1  x q)  x(q  x 1)  < h(  > 1)  j x ^)  <*2(q  x l)j  < /"  h- 

(for  all  arbitrary  unit  vectors  d^) . 

Applying  (3.10)  and  (3-11)  to  (3-9)  we  have  (with  a Joint  confidence 
coefficient  > 1 - U)  the  following  simultaneous  confidence  statement  (for 


- 9 - 


all  arbitrary  unit  vectors  d^(p  x l)  and.  d^(q.  x l)  ) j 

(3.12)  j (B  - 0)  d2j  < /"right  hand  side  of  (3.9) 
or  ultimately 


(3.13)  d|  Bd2  - /T"  < dj_  Bd2  < d^dg  + rT  , 
where 


(3.1M  e . P>J U - 6*)J  L i - °min(siisi2ss^i2)-7 

A set  of  simultaneous  confidence  bounds  on  just  the  elements  0 

0-matrix  would  be  a subset  of  the  bounds  or.  the  total  set  d'0do. 

—1  — d 


)/c  . 

' min 


of  the 
It  is 


(s  22)J. 


worthwhile  to  check  that  if  p = q = 1,  (3*15)  reduces,  as  it  should,  to 
(2.1).  .i-lsc  if  p = 1,  we  should  have  another  special  case  of  (3.13)  giving 
a set  of  simultaneous  confidence  bounds  on  all  linear  functions  of  the  partial 
regressions  of  one  variate  on  several  others.  Thus,  in  several  ways,  (3«13) 
Beems  to  be  an  appropriate  generalization  of  (2.1). 
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